Systems and methods for enhancing and developing accident scene visualizations

ABSTRACT

Systems and methods are disclosed for enhancing and developing a damage scene virtual reality (VR) visualization. Annotated immersive multimedia image(s) may be received from a first user, where the annotated immersive multimedia image(s) can be associated with a damage scene. A VR visualization of the annotated immersive multimedia image(s) may be rendered using a VR device associated with a second user. The VR visualization may be used to determine a damage amount, where the damage amount is determined from one or more damaged items identifiable in the annotated immersive multimedia image(s).

FIELD OF THE DISCLOSURE

The present disclosure generally relates to augmenting immersivemultimedia images to create annotated immersive multimedia images forvirtual reality (VR) visualization purposes, and, relates in particularto augmenting immersive multimedia images to create annotated immersivemultimedia images in order to visualize a damage scene in virtualreality.

BACKGROUND

The traditional description of damage events typically relies on witnessstatements, and, in some instances, two dimensional (2D) pictures, usedto describe the location, scene, time, and/or individuals or thingsinvolved in the damage event. Damage events can relate to a moving orparked automobile accident, a household fire, a household water damageevent, or any other damage event, which each typically include damageditems, such as a damaged vehicle or damaged home. Damage events caninclude damage scenes and damaged items, including an automobileaccident that occurred at an intersection resulting in damaged vehicles,or a house fire that occurred at a home owner's household resulting in adamaged room or room(s). Typically, such events happen suddenly, and insome cases, with few or no witnesses, such as a water damage event in ahousehold basement.

Accordingly, a problem arises during the aftermath of such events, wherewitness statements, or two dimensional (2D) pictures taken at differenttimes, such as before, during or after the event, do not coincide or areotherwise inconsistent to provide a holistic understanding of thedamages event. Such inconsistent witness statements or pictures can makeit difficult to understand the timing, scenery, facts, or othercircumstances that caused the accident or describe or show how the itemwas damaged. For example, this can create issues for companies orindividuals involved in remedial or other post-damage event services,such as insurance companies or repair services, in determining the causeof damage or otherwise determining or recreating the scene orenvironment when or at what location the related damage event occurred.

BRIEF SUMMARY

Accordingly, systems and methods are needed in order to annotate andvisualize damages scenes with additional data or information in order tomore accurately portray the environment at the time of damage (or timesjust before or after the time of damage). In various embodimentsdisclosed herein, virtual reality (VR) visualizations can be used tovisualize a damages scene. The VR visualization can include annotations,including graphics, text, video, or other information that can be usedto more accurately describe the timing, characteristics or othercircumstances related to the damage event or one or more damaged itemsassociated with the damage scene or damage event. The VR visualizationscan allow individuals, such as an individual associated with remedial orother post-damage event services, for example, an insurance claimsadjuster or other insurance representative, to visualize a damage scenethat may be augmented with annotations or other information via multiplepoint-of-view perspectives to recreate the actual scene at the time ofdamage event. In some embodiments, the VR visualizations may be used tocreate a real-time simulation video of an accident, such an automobilecrash. Accordingly, various embodiments herein allow an individual,including individuals who were not present during the damage event, tovisualize and determine the damage scene from a witness perspective. Invarious embodiments, the visualizations can allow an individual tovisualize where a witness was located during the event so as todetermine what the witness would have been able to see in the damagesscene at the time of the damage event.

In various embodiments disclosed herein, the visualization systems andmethods also provide benefits to an individual associated with a damageditem, such as the owner of a damaged vehicle or damaged household, or aclaims adjuster or other insurance representative associated with aninsurance claim filed for a damaged item. In some embodiments, the ownermay be a customer or policy holder associated with an insurance company.In such embodiments, the visualization systems and methods can enablethe owner, customer, insurance representative, or other individual togenerate or capture immersive multimedia images associated with adamages scene by taking one or more immersive multimedia images with acomputing device at the location of the damages scene. In some aspects,the immersive multimedia images may then be augmented with one or moreannotations to associate additional information with the damage event orscene. In various embodiments, the augmented immersive multimedia imagesmay then be analyzed, inspected, viewed, further annotated or otherwisemanipulated by other individuals to further enhance or more accuratelyrepresent the damage scene. In some embodiments, the immersivemultimedia images, augmented or otherwise, may be visualized in avirtual reality device for analysis, inspection, viewing, furtherannotation or other manipulation.

In some embodiments, for example, the augmented immersive multimediaimages may be used to determine an outcome associated with the damagescene or event. For example, in certain embodiments, the augmentedimmersive multimedia images may be used to visualize the damage scenewhere an insurance claims adjuster, or other insurance representative,may adjust or otherwise determine a damage amount associated with aninsurance claim related to the damage event or damage scene. In suchembodiments, for example, the immersive multimedia images may besubmitted by the owner as part of an insurance claims filing process.

In various embodiments, systems and methods are described herein forannotating and visualizing a damage scene. The systems and methods mayuse one or more processors to generate immersive multimedia image(s),where the one or more immersive multimedia images can be associated witha damage scene, such as a damages scene related to a vehicle accident ora property damage event. The immersive multimedia image(s) may include360-degree photographs, panoramic photographs, 360-degree videos,panoramic videos, or one or more photographs or videos for creating animmersive multimedia image.

In some embodiments, the immersive multimedia image(s) may be augmentedwith annotation(s) to create respective annotated immersive multimediaimage(s). In various embodiments, the annotation(s) can include any of atext-based annotation, a voice-based annotation, a graphical annotation,a video-based annotation, an augmented reality annotation, or a mixedreality annotation. For example, the damages scene may be annotated withan augmented reality annotation or a mixed reality annotation thatdescribes the damages scene at or near a time when the related damageevent occurred in order to enhance the damage scene for visualizationpurposes as described herein. In some embodiments, the annotatedimmersive multimedia image(s) may be annotated with metadata, which, forexample, can include weather or GPS information associated with thedamage scene at the time of the damage event. In some embodiments, auser can select from a display listing of preexisting annotations thatmay be used to augment immersive multimedia images to create annotatedimmersive multimedia images.

In some embodiments, the annotated immersive multimedia image(s) may bevisualized using a virtual reality (VR) device, where the damage sceneand the annotation(s) of the annotated immersive multimedia image(s) canbe viewed via the VR device.

In other embodiments, the damage scene of an immersive multimedia imagecan depict a damaged item having a point of impact annotation associatedwith the damaged item. In the example embodiment, a prior image of thedamaged item can be overlaid on or displayed together with at theimmersive multimedia image in order to show the extent of damage of thedamaged item, for example, how the item looked before it was damaged andhow it looked after it was damaged.

In other embodiments, a simulation video may be created of the damagescene based on a plurality of immersive multimedia image(s). In otherembodiments, the generation of immersive multimedia image(s) can occurat or near the damage scene, but the visualization of the immersivemultimedia image(s) can occur at a location remote to the damage sceneusing a virtual reality (VR) device.

In various embodiments, systems and methods are described herein forenhancing and developing a damage scene visualization. The systems andmethods may use one or more processors to receive annotated immersivemultimedia image(s) from a first user. In some embodiments, theannotated immersive multimedia image(s) can be associated with a damagescene.

In some embodiments, a VR visualization of the annotated immersivemultimedia image(s) may be rendered using a VR device associated with asecond user, such as a claims adjuster or insurance claims trainee of aninsurance provider, or a remedial or repair services representative of arepair or remedial company associated with repairing damaged itemsrelated to the damage scene. In some embodiments, the second user mayenhance the annotated immersive multimedia image(s) provided by thefirst user, where the annotated immersive multimedia image(s) providedby the first user are augmented by the second user with additionalannotation(s). In some embodiments, the additional annotation(s) can betransmitted from the first user via a computer network to the seconduser. In some embodiments, each of the annotated immersive multimediaimages can include timestamp value(s) that can indicate when theannotated immersive multimedia image(s) were generated, received,stored, etc.

In one example embodiment, the enhanced immersive multimedia image canbe a mixed reality immersive multimedia image, where an annotation, suchas a graphical annotation, is used to generate the mixed realityimmersive multimedia image by augmenting the annotated immersivemultimedia image(s) of the first user with the graphical annotation.

In some embodiments, a selectable list of annotation(s) may be providedto the first user, where selection of a particular annotation from thelist of annotation(s) by the first user causes the enhanced immersivemultimedia image to be augmented with the particular annotation.

In some embodiments, a verification indication may be received from thefirst user, where the verification indication indicates that theenhanced immersive multimedia image represents an interpretation of thedamage scene as determined by the first user.

In other embodiments, the first user and the second user maysimultaneously visualize the enhanced immersive multimedia image onrespective first and second VR devices. In some embodiments, the firstuser and the second user may be at remote locations.

In some embodiments, the VR visualization may be used to determine adamage amount, where the damage amount is determined from one or moredamaged items identifiable in the annotated immersive multimedia images.In some embodiments, the damaged items identifiable in the VRvisualization can have a predetermined value. In various aspects, thepredetermined values of multiple damaged items may be used to calculatethe damage amount. In some embodiments, the damage amount may bemodified, for example, by a claims adjuster of an insurance companyassociated with a damages claim.

In some embodiments, the annotated immersive multimedia images from thefirst user may be stored by a computing device at an initial time andmay be accessed to render a VR visualization at a later time.

In some embodiments, the augmented immersive multimedia images of thefirst user are capable of being displayed on a web browser ascorresponding two dimensional (2D) image(s) via an online application.

Advantages will become more apparent to those of ordinary skill in theart from the following description of the preferred embodiments whichhave been shown and described by way of illustration. As will berealized, the present embodiments may be capable of other and differentembodiments, and their details are capable of modification in variousrespects. Accordingly, the drawings and description are to be regardedas illustrative in nature and not as restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

The Figures described below depict various aspects of the system andmethods disclosed therein. It should be understood that each Figuredepicts an embodiment of a particular aspect of the disclosed system andmethods, and that each of the Figures is intended to accord with apossible embodiment thereof. Further, wherever possible, the followingdescription refers to the reference numerals included in the followingFigures, in which features depicted in multiple Figures are designatedwith consistent reference numerals.

There are shown in the drawings arrangements which are presentlydiscussed, it being understood, however, that the present embodimentsare not limited to the precise arrangements and instrumentalities shown,wherein:

FIG. 1 illustrates an exemplary network diagram in accordance withvarious embodiments of the present disclosure.

FIG. 2A illustrates an exemplary immersive multimedia image.

FIG. 2B illustrates an exemplary annotated immersive multimedia imageversion of the immersive multimedia image of FIG. 2A.

FIG. 3A illustrates an exemplary immersive multimedia image associatedwith an exemplary damages scene.

FIG. 3B illustrates an exemplary augmented-reality annotation ormixed-reality annotation immersive multimedia image version of theimmersive multimedia image of FIG. 3A.

FIG. 4 illustrates an exemplary virtual reality (VR) visualization ofthe immersive multimedia image of FIG. 2B.

FIG. 5A illustrates an exemplary user interface of a computing devicefor associating an immersive multimedia image with a damages scene.

FIG. 5B illustrates the exemplary user interface of the computing deviceof FIG. 5A depicting an immersive multimedia image associated with adamages scene.

FIG. 5C illustrates the exemplary user interface of the computing deviceof FIG. 5B depicting an exemplary annotated version of the immersivemultimedia image associated with the damages scene of FIG. 5B.

FIG. 6 illustrates a flow diagram of an exemplary method for annotatingand visualizing a damage scene.

FIG. 7 illustrates a flow diagram of an exemplary method for enhancingand developing a damage scene visualization.

The Figures depict preferred embodiments for purposes of illustrationonly. Alternative embodiments of the systems and methods illustratedherein may be employed without departing from the principles of theinvention described herein.

DETAILED DESCRIPTION

FIG. 1 illustrates an exemplary network diagram in accordance withvarious embodiments of the present disclosure. Each of damage scenes104, 106, and 108 is representative of an example damage scene that isassociated with an example damaged item and an example damage event. Inone example embodiment, damage scene 104 depicts a damaged home orhousehold that was damaged by a fire event. In another exampleembodiment, damage scene 106 depicts one or more damaged automobiles orvehicles that were damaged in an automobile accident event. In a furtherexample embodiment, damage scene 108 depicts a damaged home, household,or commercial property that experienced a water damage event. It is tobe understood that although only automobile, fire, and water damagescenes, damage events, and related damaged items are depicted anddescribed for FIG. 1, the example disclosure herein can also relate tonumerous other damage events, damage scenes, and damaged items that areapplicable to the disclosed systems and methods herein.

In various embodiments, each of the damage events could have occurred atthe respective damage scene locations, such as damage scenes 104-108,and at particular times, and may have one or more witnesses to thedamage event. In some embodiments, witnesses can include, for example,individuals involved in the damage event, such as an operator orpassenger of an automobile or vehicle that was damaged in an automobileaccident event, or a home owner, resident, occupant, visitor, customer,or other individual that witnessed a property related fire, water orother property damage event. In other embodiments, witnesses can alsoinclude individuals who were not directly involved in the damage event,but that otherwise witnessed the damage event or that were in thevicinity of the damage scene when it occurred.

In various embodiments, person 102, which may be representative ofwitnesses or other individuals at or near the damages scene, can captureimmersive multimedia images with a computing device, such as with any ofcomputing devices 120. The computing devices 120 can include a camera,photographic lens, and/or sensor for taking immersive multimedia images.Computing devices 120 can include, for example, tablet device 122,mobile phone 124, smart phone 126, camera device 128, and/or videorecorder 129. Each of the computing devices 120 can include one or moreprocessors, one or more computer memories, one or more cameras orimagining sensors for capturing or generating immersive multimediaimages. The computing devices 120 may also include software orinstructions for capturing, generating, annotating, augmenting,transmitting, interacting with, or otherwise manipulating the immersivemultimedia images.

In various embodiments, immersive multimedia images can include360-degree or panoramic photographs, and/or 360-degree or panoramicvideos. For example, a 360-degree photograph or video can be capturedusing any of computing devices 120 capable of capturing a full360-degree view of a scene, a location or an object, such as any ofdamage scenes 104-108. In one example, a user, such as person 102, mayactivate a computing device 120 and rotate 360-degrees to capture a360-degree immersive multimedia image of a scene, for example, any ofdamage scenes 104-108, from the user's vantage point. In anotherexample, a panoramic photograph or video may be captured using any ofcomputing device 120 cable of capturing a panoramic photograph or video,which may be less than a full 360-degree view of a scene, a location oran object.

In other embodiments, one or more photographs or videos, as capturedfrom a computing device 120, can be used to create an immersivemultimedia image. For example, in one embodiment, several photographsand/or videos that were not captured as 360-degree or panoramic imagescan be positioned together such that the several photographs and/orvideos create a complete 360-degree or panoramic photograph and/or videoimage. The completed 360-degree or panoramic image can represent, andessentially recreate, a scene or view that was not originally capturedas a 360-degree or panoramic image. The completed 360-degree orpanoramic image can then be used as, or used to create, an immersivemultimedia image as described herein.

In various embodiments, the immersive multimedia images may be saved inone or more memories of a computing device 120. For example, in someembodiments, the immersive multimedia images or videos may be saved invarious image or video file formats, such as Joint Photographic ExpertsGroup (JPEG), Portable Network Graphics (PNG), Tagged Image File Format(TIFF), bitmap (BMP), Moving Picture Experts Group (MPEG), or QuickTime(MOV).

In various embodiments, the computing devices 120, may have inputcontrols, such as physical buttons located on the device itself, orgraphical touchscreen inputs on the screens or user interfaces of therespective devices, for example, the screens or user interface of thesmart phone 126. The input controls allow a user, such as person 102, toprovide commands to the computing devices, such as when and how manyimmersive multimedia images to capture. The input controls may alsoallow the user to input data or select options from menus, lists,selectable graphics, or other items as displayed on a user interfacescreen of the computing device. For example, as disclosed in variousembodiments herein, the input controls, input commands, or selectablemenu items of a device 120 can allow the user to augment one or moreimmersive multimedia images with annotations, including any of atext-based annotation, a voice-based annotation, a graphical annotation,a video-based annotation, an augmented reality annotation, and/or amixed reality annotation. In some embodiments, the augmentationinformation may be saved with an immersive multimedia image file or, inother embodiments, as a separate file or files associated with theimmersive multimedia image.

In some embodiments, person 102 can also represent a non-witness. Forexample, person 102 may be associated with a provider of post-damageevent activities or services, such as an insurance representative (e.g.,a claims adjuster) of an insurance company that collects information,including immersive multimedia images, for a claim filed by a customerof the insurance company and related to an item that was damaged duringthe damage event. Other examples can include a representative ofremedial service or repair service, such as a fire and water remedialservice representative for property related damage, or an auto repairrepresentative for automobile related damage. The non-witnesses cancapture immersive multimedia images using the same methods as describedabove, for example, using computing devices, such as computing devices120, to capture immersive multimedia images of the damage scene, forexample, damage scenes 104-108. It should be understood that the aboveembodiments are examples and that other non-witnesses are contemplated,including any non-witnesses that may capture immersive multimedia imagesof a damages scene and that can be used with VR visualization asdescribe herein. For example, the Google Map service, including theStreet View feature, includes immersive multimedia images of variouspotential damages scenes and locations, such as a street interaction,that may be captured by multiple non-witnesses and that may be used withthe systems and methods herein.

In various embodiments as described herein, the immersive multimediaimages can be visualized in a virtual reality (VR) device, such as firstVR device 130 or second VR device 154. In some embodiments, for example,as depicted for FIG. 4, the VR visualizations can be viewed by a user,such as person 102, via a VR device, such as first VR device 130. Invarious embodiments, Virtual Reality (VR) can refer to an immersive userexperience, where the user can experience the sensation of a threedimensional (3D) environment. For example, in one embodiment, thevisualization of immersive multimedia image(s) can be used to create areal-world experience for a user, such as person 102, as if the VR userwere actually present at the scene or location that the immersivemultimedia images were originally taken. In various embodiments describeherein, the VR images can be visualized with a VR device, such as thefirst VR device 130 or the second VR device 154, and the user caninteract with the VR environment with the VR device. For example, asdescribed herein, in some embodiments, the VR device, such as the firstVR device 130 or the second VR device 154, may have several inputoptions, such as buttons or controls associated with the VR device. Inother embodiments, the VR device, such as the first VR device 130 or thesecond VR device 154, may allow input via voice commands or user hand orother body gestures.

A technology related to VR is Augmented Reality (AR). In variousembodiments, augmented reality can generally refer to an annotation,overlay, or augmentation of text or media content, such as graphicscontent, onto real-world immersive multimedia images, such asphotographs or video of a real-world damage scene, such as damagesscenes 104-108. For example, in some embodiments, augmented reality caninclude annotating (or supplementing) a real-world immersive multimediaimage to include text, voice, graphics, video, GPS data, metadata, orother annotated content. In some embodiments, the annotations cancreate, or form, augmented reality multimedia immersive images that arecapable of being viewed in a VR device, such as first VR device 130and/or second VR device 154, as further describe herein. In suchembodiments, the annotations of the augmented reality multimediaimmersive image may be viewed together with a real-world scene in the VRdevice. In some embodiments, the annotated content may be interactive,where the user of the VR device can select, move, alter, or otherwiseinteract with the annotated content that appears within a VRvisualization as describe herein.

An additional related technology to VR is Mixed Reality (MR). In variousembodiments, mixed reality can generally refer to an annotation,overlay, augmentation, or mixing of synthetic content, such as computergenerated graphics, virtual scenery, virtual images, or other mixedreality content, with real-world immersive multimedia images, such asreal-world photographs or video of a damages scene, such as any of thedamage scenes 104-108. In various embodiments, the mixed reality contentmay appear anchored to or as part of real-world scenery of the immersivemultimedia images. In some embodiments, the mixed reality content may bereadily discernible as computer generated content to contrast againstthe real-world immersive multimedia images into which it is embedded. Inother embodiments, the mixed reality content may be life-like so as notto be (or to be just barely) discernible from the real-world immersivemultimedia images into which it is embedded. In some embodiments, themixed reality content can create or form mixed reality multimediaimmersive image(s) that are capable of being viewed in a VR device, suchas first VR device 130 and/or second VR device 154. In such embodiments,the mixed reality content of the mixed reality multimedia immersiveimage(s) may be viewed together with a real-world scene in the VRdevice. In some embodiments, the mixed content may be interactive withthe real-world content. For example, a user of a VR device, such asfirst VR device 130 or second VR device 154, may visualize mixed realitycontent, such as a virtual vehicle, that appears as if it were movingwithin VR visualization based on one or more real-world immersivemultimedia images or other metadata as describe herein. In otherembodiments, the mixed reality content may be interactive with themultimedia immersive image(s) in real-time.

In other embodiments, a user, such as person 102, may annotate amultimedia immersive image with mixed reality content using either acomputing device 120 or VR device (such as first VR device 130 or secondVR device 154) at the same the user captures the multimedia immersiveimage. In another embodiment, a user may annotate a multimedia immersiveimage with mixed reality content of an already captured multimediaimmersive image, such as when the user is analyzing or reviewing themultimedia immersive image with a computing device or VR device, such asany of computing devices 120, first VR device 130, or second VR device154.

The VR devices describe herein, such as VR devices 130 and 154, may beany computing device capable of visualizing immersive multimedia imagesto create a virtual reality experience for the user. In someembodiments, for example, VR devices 130 and 154 may be any commercialVR device, such as a Google Cardboard device, a Google Daydream viewdevice, an Oculus Rift device, a PlayStation VR device, a Samsung GearVR device, or an HTC Vive device. Each of these VR devices may use oneor more processors capable of visualizing immersive multimedia images invirtual reality. For example, the Google Cardboard VR device includes aVR headset that uses one or more processors of an embedded smart phone,such as smart phone 126, which, in some embodiments, can be a GoogleAndroid-based or Apple iOS-based smart phone, or other similar computingdevice, to visualize the immersive multimedia images in virtual reality.Other VR devices, such as the Oculus Rift, may include a VR headset thatuses one or more processors of a computing device, such a personalcomputer/laptop 132, for visualizing immersive multimedia images invirtual reality. The personal computer/laptop 132 may include one ormore processors, one or more computer memories, and software or computerinstructions for performing the visualizations, annotations, ortransmission of immersive multimedia images or VR visualizations asdescribed herein. Still further, other VR devices may include one ormore processors as part of a VR headset that can operate independentlyfrom the processor(s) of a different computing device for the purpose ofvisualizing immersive multimedia images in virtual reality. The first VRdevice 130 may also include software or computer instructions forcapturing, generating, annotating, augmenting, transmitting, interactingwith, or otherwise manipulating the VR visualizations.

In some embodiments, the headsets of the VR devices, such as theheadsets of first VR device 130 or second VR device 154, can includefocal distance lenses, such as 40 mm focal distance lenses, to focus auser's vision on a VR visualization, such as the exemplary VRvisualization as described for FIG. 4. The distance from the VR headsethousing to the screen interface, such as the screen interface of a smartphone 126 in a Google Cardboard headset, as viewed through the focaldistance lenses can create a virtual reality experience for the user,such as person 102.

In various embodiments, the VR devices 130 and 154 may include embeddedsensors that track a user's head motions and adjust the viewpoint of theVR visualization to simulate a virtual reality environment, giving theuser the sensation that the user is looking around within a 3D world. Insome embodiments, the embedded sensors may be sensors associated withthe mobile device or other computing device that is embedded in the VRheadset. In other embodiments, the sensors may be part of the VR deviceitself.

In various embodiments, first VR device 130 and/or second VR device 154,can include input controls. For example, in some embodiments, the inputscontrol can be push buttons located on the VR devices 130 and/or 154. Inother embodiments, the buttons can include magnets attached to the VRdevice's housing, where the magnets interact with a computing deviceembedded in the VR headset, such as a smart phone 126, to cause thecomputing device to sense (e.g., via a magnetometer located in thecomputing device) movements of the magnet when pressed, thereby actingas an input source for the VR device. In other embodiments the inputcontrols may include separate joysticks or wired or wireless controllersthat a user may manipulate by hand to control the VR device and/orvisualizations of the VR device. Still further, in other embodiments,the VR device, or its associated smart phone 126 or personal computer132, may allow input commands via voice or body gestures to control theVR device and/or visualizations of the VR device.

In various embodiments, the input controls of the VR devices, such asfirst VR device 130 and second VR device 154, allow a user to interactwith the VR visualization, where the user, wearing a VR device, such asfirst VR device 130 or second VR device 154, can provide input toanalyze, review, augment, annotate, or otherwise interact with the VRvisualization as described herein. In some embodiments, a user may usethe input controls to select from a menu or list displayed within the VRvisualization. For example, the displayed menu or list may includeoptions to navigate or highlight certain views or features of the VRvisualization. In other embodiments, graphics or items may beinteractive or selectable with the VR visualization. Still further, inother embodiments, the user may provide textual, graphical, video orother input to the VR visualization in order to augment, or annotate theVR visualization. In some embodiments, augmentation or annotation of theVR visualization will cause the same augmentation or annotations toappear in the immersive multimedia image(s), upon which the VRvisualization is based, and/or vice versa.

In various embodiments, the input controls may be used with a crosshairor other indicator visible to the user within the VR visualization, suchthat the user hovering the crosshair or other indicator over a menu,list, graphic, text, video, or other item within the visualization canallow the user to interact with item, such as by clicking, pushing, orotherwise selecting the input control to confirm a selection orotherwise manipulate the item that the crosshair or other indicator isfocused on.

In various embodiments, the immersive multimedia images and/or VRvisualizations may be submitted to a provider, such as an insurancecompany or remedial services company, via a computer network, such ascomputer network 140. Computer network 140 may be any computer network,such as the Internet (with or without the use of security protocols,such as Secured Sockets Layer and/or Transport Layer Security), aprivate network operated by the provider, or a secure virtual privatenetwork of the provider operated over the Internet. In some embodiments,a user, such as person 102, may transmit immersive multimedia imagesand/or VR visualizations directly from a computing device 120, forexample, smart phone 126 which may have been used to capture or generatethe immersive multimedia images and/or VR visualizations. In otherembodiments, the user may first transfer the immersive multimedia imagesand/or VR visualizations to either the personal computer/laptop 132 orfirst VR device 130, for example, for augmentation or annotationpurposes, and then transmit the immersive multimedia images and/or VRvisualizations from the respective devices to the provider via computernetwork 140.

In some embodiments, the personal computer/laptop 132 may be connectedto computer network 140 via a wired connection, such as an Ethernetconnection, for example, wired connection 133 connecting the personalcomputer 132 to the computer network 140. In other embodiments, thecomputing devices 120 may be connected to the computer network 140 via awireless connection 136 in communication with wireless base station 134.In some embodiments, the wireless connection may include a mobile phoneor cellular phone connection based on any of a number of mobile orcellular formats or protocols, including, for example, Global System forMobile Communications (GSM), Code Division Multiple Access (CDMA),Universal Mobile Telecommunications System (UTMSO, Long Term Evolution(LTE), etc. In other embodiments, the wireless connection can include aWiFi or Bluetooth based connection and the base station can be a WiFirouter or Bluetooth device, such as a Bluetooth radio, for receivingwireless transmissions from a computing device 120 or first VR device130.

The immersive multimedia images and/or VR visualizations, together withany related files as described herein, may be transmitted to a providerserver(s) 150 via computer network 140. The provider server(s) 150 maybe associated with a provider of post-damage event activities orservices, for example, an insurance company, a remedial service company,or a repair company. It is to be understood that, while the examplesherein describe the provider as an insurance company, a remedial servicecompany, or a repair company, the provider server(s) 150 may also beassociated with other companies or individuals that may have an interestin providing services or activities related to the damage event, damagescene or damage item, and may benefit or otherwise use the systems andmethods disclosed herein. The provider server(s) 150 may include anynumber of server computers, which can operate as a server farm, and caninclude one or more processors, one or more computer memories, andsoftware or computer instructions for receiving immersive multimediaimages and/or VR visualizations, and any related files, and forotherwise communicating with users, such as person 102, that submit theimmersive multimedia images and/or VR visualizations, and any relatedfiles, to server(s) 150 as described herein. The immersive multimediaimages and/or VR visualizations, and any related files, may be stored inthe one or more memories of the server(s) 150, which can include one ormore database(s) (not shown) associated with the server(s) 150. In someembodiments, the server(s) 150 and/or databases may be replicated and/orgeographically distributed to provide disaster recovery and supportfunctionality.

In some embodiments, the immersive multimedia images and/or VRvisualizations may be annotated, for example, by person 102, and asfurther described herein, prior to transmission to the providerserver(s) 150. In other embodiments, the immersive multimedia imagesand/or VR visualizations may be annotated after they are received at theprovider server(s) 150. For example, in some embodiments, a second userat the provider server(s) 150, such as an employee or representative ofthe provider, can annotate the immersive multimedia images and/or VRvisualizations submitted by a first user, such as person 102. In oneexample embodiment, the first user may annotate the immersive multimediaimages and/or VR visualizations using a computing device 120 or first VRdevice 130. In another example embodiment, the second user can annotatethe immersive multimedia images using an online application, which, insome embodiments, may be operable via server(s) 150 as a web page via aweb browser on provider computing device 152. The provider computingdevice 152 can include a personal computer, such as a laptop or othercomputer with one or more processors and software or computerinstructions that is connected to server 150 for accessing the immersivemultimedia images and/or VR visualization, and related files, if any,via server(s) 150. In another embodiment, the second user can annotatethe VR visualizations using the second VR device 154. The second VRdevice 154 can be the same or similar type of device as described forfirst VR device 130, such as a Google Cardboard VR device, such that thedisclosure herein for first VR device 130 applies equally for second VRdevice 154.

In some embodiments, as described herein, the immersive multimediaimages and/or VR visualizations may be supplemented with or otherwiseenhanced with media or metadata, including information, graphics, video,or other immersive multimedia images or VR visualizations. In someembodiments, the media or metadata can include metadata from theprovider, for example, via provider server(s) 150. For example, aprovider can capture its own immersive multimedia images, VRvisualizations, or information of a damages scene and store thatinformation on provider server(s) 150. The provider's immersivemultimedia images, VR visualizations, or information can then be used tosupplement the immersive multimedia images, VR visualizations, orinformation submitted by the provider's customer or other user.

In other embodiments, the metadata may be sourced from third partyresources, for example, third party server(s) 160, that collect andstore metadata that may be useful to describe or enhance the immersivemultimedia images, VR visualizations, or other information related to adamages scene or damaged item as describe herein. For example, thirdparty server(s) 160 may represent a weather data service, such as theweather data service provided by the online National Weather Service(weather.gov), that may be accessed, for example, by a user or provider,to annotate immersive multimedia images and/or VR visualizations withweather data at the time and geographic location of the damage event. Inanother embodiment, the server(s) 160 may represent a map service, suchas the Google Maps service (maps.google.com), that may be accessed, forexample, by a user or provider, to annotate immersive multimedia imagesand/or VR visualizations with additional immersive multimedia imagesand/or VR visualizations, such as those provided by Google's Street Viewservice associated with the Google Maps service. Additional examples ofthird party services for annotating immersive multimedia images and/orVR visualizations with metadata, content, or other information aredescribed further herein.

FIG. 2A illustrates an exemplary immersive multimedia image 202 a. Insome embodiments, the immersive multimedia image 202 a depicted in FIG.2A may represent a portion of, or depict a certain vantage point of, acomplete immersive multimedia image, such as a panorama or 360-degreeimmersive multimedia image, that may be rotatable with a computingdevice 120 or VR device (e.g., first VR device 130) to see additionalportions or vantage points of an environment or scene related to theimmersive multimedia image 202 a as described further herein. Theexemplary embodiment of immersive multimedia image 202 a depicts adamaged item, vehicle 204, that experienced a damage event, such as anautomobile accident, in a damage scene, for example, a parking lot. Theimmersive multimedia image 202 a may contain a complete 360 view of theparking lot, including entrances, exits, isles, and parking spot/parkingspace of the parking lot. As descried further herein, the variousembodiments described for the immersive multimedia images and/orvisualizations depicted for FIGS. 2A, 2B, 3A, 3B, 4, and 5A-5C relate toa parking lot damage scene embodiment, where a vehicle (i.e., thedamaged item) has experienced a damage event, such as an automobileaccident. It is to be understood, however, that the various descriptionsand embodiments with respect to FIGS. 2A, 2B, 3A, 3B, 4, and 5A-5C mayapply in the same or similar manner to other embodiments regarding otheror different damage scene(s), damage event(s), damage item(s), etc.

In various embodiments, the immersive multimedia image 202 a is capableof being viewed and/or manipulated via a computing device, such as anyof a computing device 120, personal computer/laptop 132, and/or providercomputing device 152 of FIG. 1. The computing device may have a softwareapplication or “App”, such as an iOS-based App or Android-based App fora smart phone, such as smart phone 126, for displaying or allowinginteraction with the immersive multimedia image 202 a. In otherembodiments, a computing device 120 may access an online application viaa web browser, such as an online application associated with server(s)150, for displaying or allowing interaction with the immersivemultimedia image 202 a.

In some embodiments, a user may annotate the immersive multimedia image202 a with metadata, as described herein, by selecting the annotationicon 212 using the interface of a computing device 120. Selection of theannotation icon 212 may cause a list, menu, or input box, or other inputoptions to be displayed so that the user may input text, graphics, orother media or content for annotating or augmenting the immersivemultimedia image 202 a in accordance with the disclosures herein.

In other embodiments, a user may select full screen icon 216 to open apanorama or 360-degree immersive multimedia image in a full screen mode.Full screen mode can allow the user to rotate or change the view of theimmersive multimedia image 202 a on the user interface of the computingdevice so as to see different viewing angles or vantage points. Forexample, for the immersive multimedia image 202 a, a user may rotate theview so as to view additional portions of the parking lot, or otherdamage scene characteristics, within the vicinity of vehicle 204. Whilein full screen mode, the user may annotate the immersive multimediaimage 202 a with text, graphics, or other annotations as describedherein.

In other embodiments, a user may select VR icon 214 to launch or openvirtual reality (VR) mode for immersive multimedia image 202 a. Thevirtual reality mode may be used to visualize immersive multimedia image202 a as a VR visualization as further described herein. While in VRmode, the user may annotate the immersive multimedia image 202 a withtext, graphics, or other annotations as described herein.

FIG. 2B illustrates an exemplary annotated immersive multimedia image202 b version of the immersive multimedia image 202 a of FIG. 2A. Forexample, in some embodiments, as shown for FIG. 2B, the immersivemultimedia image 202 a may be annotated with text-based annotations,which may include tags or descriptors, to create annotated immersivemultimedia image 202 b.

The annotated immersive multimedia image 202 b depicts a text-basedannotation 256 (“point of impact”) superimposed on top of the damageditem, vehicle 204, to indicate the point of impact, or damage,associated with the damaged vehicle 204, such as a damaged tail light.In some embodiments, the annotation may have be made by a user selectingannotation icon 212, selecting the location within the immersivemultimedia image 202 a to place the annotation (such as over the damagepoint on vehicle 204), and inputting the text “point of impact” on thedamage point of vehicle 204.

In other embodiments, other annotations may indicate multiple points ofimpact or points of damage, such as to show the various locations on thedamaged item, such as a vehicle 204, where damage to the damaged itemhas occurred. Still, in further embodiments, the annotation may indicateor associate a degree of damage per impact or location, such as anindication of the “main point of impact” or “main point of damage” toindicate the point on the vehicle or other damaged item that had themost severe damage compared with any other point associated with thedamaged item.

In other embodiments, other annotations may be used to annotateimmersive multimedia images, such as immersive multimedia image 202 a.For example, in addition to text-based annotations, other sources ofdata, such as metadata or other information, may be used to annotateimmersive multimedia images. The other sources of data, eitherindividually, or with each other, can be superimposed, overlaid orotherwise associated with the immersive multimedia image(s) to augmentthe immersive multimedia image(s) to create annotated immersivemultimedia images, such as the text-based annotated immersive multimediaimage 202 b. For example, annotated immersive multimedia image(s) caninclude any of a text-based annotation, a voice-based annotation, agraphical annotation, a video-based annotation, an augmented realityannotation, or a mixed reality annotation. In various embodiments, thedata or other information may be added as metadata that can be part ofan immersive multimedia image or as one or more separate filesassociated with the immersive multimedia image.

In some embodiments, the sources of data can include additionalinformation or media provided by the user who originally captured theimmersive multimedia images (e.g., represented by person 102 of FIG. 1),such as a witness to the damage event at the damage scene. In otherembodiments, the sources of data can include additional information ormedia provided by a user who was not at the damage scene (e.g., alsorepresented by person 102 of FIG. 1), such as a provider representative,who desires to annotate or capture immersive multimedia images used toprovide post-damage services, such as a claims adjuster collectingevidence for claim, or a remedial or repair representative collectingdamage information used to determine costs or activities to perform torepair related damaged items. Still further, in other embodiments, thesources of data can include media or information from third parties thatmay be accessible, for example, via third party server(s) 160, and thenassociated as metadata with the immersive multimedia images.

In one example embodiment, a voice-base annotation may be added toimmersive multimedia image 202 a. For example, a user may selectannotation icon 212 and select a “voice” option from a menu that wouldcause the computing device (e.g., smart phone 126) to prompt the userfor voice input. The user could then narrate, using a microphoneassociated with smart phone 126, his or her account of how damageoccurred to vehicle 204 and could describe, for example, the point ofimpact annotation 204 in greater detail.

In another example embodiment, a graphical annotation may be added tothe immersive multimedia image 202 a. For example, a user may selectannotation icon 212 and select a “graphical” option from a menu thatwould cause the computing device (e.g., smart phone 126) to prompt theuser for graphical input. The user could then superimpose a graphic orgraphical item onto the immersive multimedia image 202 a to create a newannotated immersive multimedia image that included the graphic. In oneexample embodiment, the graphic could include a map image as sourcedfrom Google Maps. For example, the user could retrieve a satellite imageof the parking lot (e.g., the damage scene) from server(s) 160 where thedamage event occurred. The user, selecting annotation icon 212, couldchoose to input the satellite image by overlaying the satellite image ontop of the parking lot shown in the immersive multimedia image 202 a inorder to provide additional information, such as intersections,entrances, exits, nearby roads, etc. that may have not been capturedoriginally in the immersive multimedia image 202 a. In anotherembodiment, the user may choose to simply associate the satellite imagewith the immersive multimedia image as metadata, such that the satelliteimage may be accessed later by a link (not shown) displayed on theannotated version of the immersive multimedia image 202 a so that theuser, or a second user, may quickly access and see the intersections,entrances, exits, nearby roads as a satellite map. Still further, inother embodiments, the user may annotate the immersive multimedia image202 a with additional immersive multimedia image(s) such as additionalimmersive multimedia image(s) provided by Google's Street View service.In such an embodiment, the user, selecting annotation icon 212, couldchoose to annotate immersive multimedia image 202 a with a Google StreetView image by either overlaying or positioning the Google Street Viewimage with the immersive multimedia image 202 a, or by saving the GoogleStreet View image as metadata (e.g., as an additional image for viewingby the selection of link), in order to provide additional information,such as intersections, entrances, exits, nearby roads, etc. of thedamage scene parking lot that may have not been captured originally inthe immersive multimedia image 202 a.

In further embodiments, an immersive multimedia image, such as immersivemultimedia image 202 a, may be annotated by superimposing or associatinga graphic, photograph, or other immersive multimedia image of a previous(non-damaged) version of a damaged item onto, or with, the currentlydamaged item as shown in the immersive multimedia image 202 a. Forexample, a previous image of a non-damaged version of vehicle 204 may besuperimposed with the damaged version of vehicle 204 so that a user candetermine the extent of damage of the damaged item or determine how theitem appeared before it was damaged. In another example embodiment, aprevious image of non-damaged version of a basement of a household maybe superimposed with the damaged version of the basement of the samehousehold so that a user can determine the extent of damage or determinehow the basement appeared before it was damaged. In other embodiments,the graphic or image may instead be associated with the immersivemultimedia image (instead of superimposed on top of it), such that theuser could view the previous version of the damaged item side-by-side,or in a similar manner, with the immersive multimedia image. In asimilar embodiment, the user may view the damaged and non-damagedversions by selecting a link to display the previous version of thenon-damaged item in a separate screen or window of the computing devicethan the immersive multimedia image that shows the damaged version. Insome embodiments, the previous graphics or images may be actual graphicsor images of the item before the item was damage. In other embodiments,the previous graphics or images may be graphics or images of the same ora similarly manufactured item that shows how the actual damage itemwould have appeared before it was damaged. The graphics or images can besourced from the user who originally captured the immersive multimediaimage or from a third party source, such as from third party server(s)160. For example, photographs of the basement of the household that wasdamaged could be sourced from third party Zillow (zillow.com), which maycontain photographs of the basement of the household before it wasdamaged, e.g., from when the household was up for sale prior to thedamage event.

In other embodiments, other sources of data can include weather data,Global Positioning System (GPS) data, or any other data that can beassociated and/or used to annotate immersive multimedia images. Incertain embodiments, such data can be used as metadata to annotate theimmersive multimedia images. For example, in certain embodiments, animmersive multimedia image, such as immersive multimedia image 202 a,can be annotated to include weather data, such as the temperature, thehumidity, the lighting conditions, or the road conditions (e.g., icy orwet). The metadata can also include the time of day of the damage eventand the geographic location of the damage scene. In some embodiments,the weather related data may be accessed from third party sources, suchas third party server(s) 160. For example, in certain embodiments,temperature, humidity, and/or road conditions (e.g., whether the roadwas icy or wet) for the time when the accident occurred can be accessedthird party Waze (waze.com) or the National Weather Service(weather.gov), which can provide publically available data used toannotate the immersive multimedia image 202 a.

In other embodiments, GPS data may also be used to annotate an immersivemultimedia image, such as immersive multimedia image 202 a. In such anembodiment, the GPS data could include a geographic location for thedamage scene and/or timestamp when the damage event occurred. In otherembodiments, a user may add geographic location information or timestampinformation after the damage event occurred. In certain embodiments, theGPS data can be used to annotate the immersive multimedia image so thatthe GPS data is displayed on a screen, such as a screen of a computingdevice 120, with the immersive multimedia image 202 a. In otherembodiments, a user may have to select a link to view or otherwise showthe GPS data.

Other metadata may include information provided by witnesses, such asthe driver of the vehicle, or other individuals associated with thedamages scene. In one embodiment, for example, such witness-basedmetadata may include whether a driver was able to see a stop sign thatwas in the vicinity of the damage scene. In another embodiment, forexample, the content of other witnesses, such as witnesses who posteddescriptions, static photographs, or videos of the damage event ordamage scene on social media platforms (e.g., such as Facebook), may beaccessed and added to or used to annotate immersive multimedia images.

In still a further embodiment, police records, including witnessstatements taken by police officers that witnessed the damage scene orthat were present at the damage scene after the damage event may be usedto annotate the immersive multimedia images. The police records may berecallable by a link provided with a viewing application of thecomputing device displaying the immersive multimedia image.

In other embodiments, public or private images or data associated withthe damage scene may be used to annotate immersive multimedia images,such as immersive multimedia image 202 a. In the example embodiment forimmersive multimedia image 202 a, the parking lot operator may store ortrack parking data, such as when a vehicle entered the parking lot orwhen the vehicle exited parking lot, how long a vehicle remained in theparking lot, etc. Such data may be stored in third party server(s) 160.Such parking lot information could be accessed and used to annotate theimmersive multimedia image 202 a, tracking when the damaged vehicle, ora vehicle that caused the damage to the damaged vehicle, entered theparking lot, etc.

In another embodiment, video data or images from live video cameras(e.g., public or private cameras) may also be stored, e.g., in server(s)160, and can be used to annotate immersive multimedia images. In theexample embodiment, for immersive multimedia image 202 a, the parkinglot operator may operate one or more of video cameras, which may captureimages of the damage event at the damage scene. In another embodiment,video images of a dashboard or other camera device associated a movingvehicle, such as a police vehicle patrolling the parking lot, may alsobe captured and stored in server(s) 160. In one embodiment, the videoimages could be accessed via server(s) 160 and used to annotate theimmersive multimedia image 202 a, depicting how the damaged vehicle, ora vehicle that caused the damage to the damaged vehicle, entered theparking lot, caused the damage, etc.

In a further embodiment, various types of data and/or images may be usedto recreate the motion or a simulated video of a damage event forvisualization purposes. In one example embodiment for immersivemultimedia image 202 a, an automobile accident may be recreated based onvehicular telematics data collected for the vehicle, for example, suchas a computing device associated with the vehicle that collects thespeed of the vehicle at a particular time, if and when the vehicle'sairbags were deployed, whether the vehicle, or other vehicle that causedthe accident, was being operated at or below the speed limit, etc. Thevehicular telematics data may be used together with any of the videoimages, map information, other immersive multimedia images, such asimmersive multimedia images from the Google Street View service,dashboard camera views, witness statements, and/or weather data,lighting data, as described herein, to reconstruct and annotate one ormore immersive multimedia images in order to simulate and visualize thedamage event as it would have happened at the time of the actual crashand within the damage scene. In some embodiments, depending on the dataavailable, areas, such as roads, intersections, or areas of the parkinglot, just before where the vehicle entered the damage scene may also beused to create or annotate immersive multimedia images for visualizationpurposes as described herein.

FIG. 3A illustrates an exemplary immersive multimedia image 302 aassociated with an exemplary damages scene, which, in the embodimentshown for immersive multimedia image 302 a, is a parking lot associatedwith automobile accident. For example, the immersive multimedia image302 a may be associated with the parking lot damage scene as describedherein for FIGS. 2A and 2B. In one embodiment, for example, immersivemultimedia image 302 a can be the same immersive multimedia image asimmersive multimedia image 202 a, but is represented at a differentviewing angle or vantage point within the image where a user, using acomputing device 120 and selecting full screen icon 216, rotated orotherwise changed the view of the immersive multimedia image 202 a todepict the view as shown in immersive multimedia image 302 a. Themultimedia image 302 a may show a particular isle or lane of the parkinglot with parked vehicles 304 and 306 on the left side of the lane.

FIG. 3B illustrates an exemplary augmented-reality annotation ormixed-reality annotation immersive multimedia image 302 b version of theimmersive multimedia image 302 a of FIG. 3A. In the example embodimentfor annotated immersive multimedia image 302 b, a computer graphic orimage of a vehicle, augmented vehicle 360, is added to the immersivemultimedia image 302 a. In certain embodiments, the augmented vehicle360 could represent the vehicle that caused the accident (i.e., thedamage event) or the vehicle that was damaged (i.e., the damaged item)of the damage scene (i.e., the parking lot). In certain embodiments, theaugmented vehicle 360 could be positioned in the immersive multimediaimage 302 a based on witness statements, or other information,describing or showing one or more locations of the augmented vehicle 360at a particular time before or during the damage event, to create theaugmented or mixed reality annotated immersive multimedia image 302 b.For example, in the embodiment of immersive multimedia image 302 b, theaugmented vehicle 360 could represent the vehicle that caused theaccident, where the vehicle was turning at a wide angle into the parkinglane, or that the vehicle was improperly driving through empty parkinglot spaces, or that the vehicle was speeding in the parking lot. Inother embodiments, the immersive multimedia image 302 b may further beannotated with additional augmented vehicles to show the location ofadditional parked cars in the parking lot.

In another embodiment, an immersive multimedia image of a householdinterior (not shown) may be augmented to show a stove or fireplace fromwhich a fire that caused damage supposedly started. The fire could havedestroyed the stove or fireplace such as to make the stove or fireplaceunrecognizable within the immersive multimedia image depicting therelated damage scene. The augmented stove or fireplace may be positionedwithin the immersive multimedia image of the household interior tocreate an augmented or mixed reality annotated immersive multimediaimage version showing where the stove or fireplace was prior to the firedamage event. In either case, the augmented or mixed reality annotationswould be viewable in VR visualizations of the respective immersivemultimedia images as described herein.

FIG. 4 illustrates exemplary virtual reality (VR) visualization 402 ofthe immersive multimedia image 202 b of FIG. 2B. For example, text-basedannotations 406 and 408 (“point of impact” annotations) correspond totext-based annotation 256 of multimedia image 202 b of FIG. 2B. In someembodiments, the VR visualization 402 may be displayed on a screenassociated with a VR device, such as first VR device 130 or 154. Thescreen may be the screen of smart phone 126 that is housed in a VRdevice, such as first VR device 130 or second VR device 154, such as theGoogle Cardboard device. In other embodiments, the screen, or in somecases multiple screens are built into the VR device, such as first VRdevice 130 or second VR device 154, such as the two screens of an OculusRift device. Selecting arrow 404 will take the user back to the previousscreen, such as multimedia image 202 b of FIG. 2B.

The VR visualization 402 depicts a VR rendering of the immersivemultimedia image 202 b. In the example embodiment, VR visualization 402includes a pair of VR viewports (416 and 418) displayed side by side,one for each eye. Each of the VR viewports 416 and 418 can includeannotations of the immersive multimedia image on which the viewports arebased, which, for immersive multimedia image 202 b, includes thetext-based “point of impact” annotation for the damaged vehicle 204. TheVR device, such as first VR device 130 or second VR device 154, containsa set of lenses that focus a user's eyes on, and that reshape each ofthe VR viewports for each eye, thereby creating a stereoscopic 3D imagethat gives the user the sensation that he or she is in a virtual realityenvironment, such as the parking lot damages scene for the embodiment ofVR visualization 402. The gear icon 414 can be selected to access asetting menu for calibrating or adjusting the settings the VRvisualization 402.

In various embodiments, a VR visualization can be rendered in a VRdevice, such as VR devices 130 and 154 of FIG. 1, based as the immersivemultimedia images loaded into the respective VR device. In someembodiments, one or more VR visualizations may be generated as filesthat may be loaded into the VR device. For example, the VRvisualization(s) files can be generated by a separate computing device,such as a different computing device 120, a VR device, personalcomputer, or server, and stored within a database, such as a databaseassociated with server(s) 150. In such an embodiment, the stored VRvisualization(s) files can be accessed by and loaded in the VR devicefor visualization. In other embodiments, the immersive multimedia imagesmay be loaded into the Random Access Memory (RAM) for renderingrespective VR visualizations without first creating a file. In such anembodiment, the VR visualization may be generated dynamically by the oneor more processors of, or associated with, the VR device and displayedto the user.

In some embodiments, the VR visualization(s) can be generated beforethey are transmitted over a computer network, such as computer network140. In such embodiments, the VR visualization may be created by acomputing device 120, the first VR device 130 or the personalcomputer/laptop 132. In other embodiments, the VR visualization(s) aregenerated based on immersive multimedia images that were transmitted viacomputer network 140. For example, in one embodiment, a first user, suchas person 102, may transmit annotated or non-annotated immersivemultimedia images to provider server(s) 150, where a second user, suchas a representative of the provider associated with provider server(s)150, may generate VR visualization(s) based on the first user'sannotated or non-annotated immersive multimedia images using providercomputing device 152 or second VR device 154.

FIG. 5A illustrates an exemplary user interface 500 of a computingdevice for associating an immersive multimedia image with a damagesscene. In one embodiment, for example, the computing device may be smartphone 126, which includes a Claims App 502 for displaying user interface500. In some embodiments, the Claims App 502 may be implemented assoftware or computer instructions, such as Java code on the GoogleAndroid platform, or as Objective-C or Swift code on the Apple iOSplatform. In the example embodiment of FIGS. 5A-5C, a user, such as aninsured customer of an insurance company, can file an insurance claim,and related annotated multimedia images, to the insurance companyregarding damage that the user's vehicle experienced in a parking lot.For example, the user's vehicle may be vehicle 204 from FIGS. 2A and 2B,such that, as described herein, the user (e.g., person 102 of FIG. 1)can capture immersive multimedia images for the damaged vehicle 204,annotate the immersive multimedia images for the damaged vehicle 204,and submit the immersive multimedia images for the damaged vehicle 204to the insurance company's servers, such as server(s) 150. For example,using Claims App 502, the user may file an insurance claim 510 which maybe assigned a related claims number (e.g., “#201-2300068) and that mayidentify the type of vehicle that was damaged (e.g., a “2015 FordEscape”). The claim may also be assigned a particular insurancerepresentative to handle the claim, such as a claims handler or claimsadjuster 512 (e.g., “Robert Frost”). The information submitted by theuser may also include additional information (514) including the user'sinformation and other information related to the damage event, which caninclude the insured user's contact name (e.g., “Amy Wells”), a phonenumber by which the user may be contacted (e.g., “(309)123-5555”), thedate that the damage event occurred (e.g., the “Loss Date: Jun. 14,2016”), a location of the damage scene (e.g., the “Loss Location:Veterans Pkway. Bloomington Ill.”), and an indication of where theinformation was submitted from and who submitted the information (e.g.,“Scene of the Accident—Insured submitted”). Information that includes adescription of damage event (516) may also be submitted using the ClaimsApp 502, where the user can submit detail of the damage event and damagescene (e.g., “The insured was attempting to turn left from Veterans Pkwyon to College Ave. when she was struck by a vehicle heading west thatbroke a red light.”).

In some embodiments, the information 510-516 may be stored or mayotherwise be separate from any immersive multimedia images submitted bythe user. In other embodiments, the information 510-516 may be used toaugment or annotate the any immersive multimedia images submitted by theuser, such as with metadata or otherwise as described herein.

As shown in the embodiment of FIG. 5A, the user may also use the ClaimsApp 502 to add and submit one or more immersive multimedia images. Forexample, the damages scene can be captured via immersive multimediaimages, including one or more immersive multimedia photographs and/orimmersive multimedia videos. The user may then add the immersivemultimedia images to the Claims App 502 by selecting an input option(504), such as “Add 360 Photo” from a menu displayed by the Claims App502. In some embodiments, the immersive multimedia images may be storedin one or more memories of the computing device that that the Claims Appis operating. In other embodiments, the immersive multimedia images maybe transmitted to remote server for storage, such as the insurancecompany's provider server(s) 150.

FIG. 5B illustrates the exemplary user interface 500 of the computingdevice of FIG. 5A depicting an immersive multimedia image 518 associatedwith a damages scene. In the example embodiment, the immersivemultimedia image 518 represents the parking lot damage scene associatedwith the damages claim filed by the user as described for FIG. 5A. Inthe present embodiment, the immersive multimedia image 518 has beenadded to the user interface 500 of the Claims App 502. The immersivemultimedia image 518 is operable to be annotated using, for example, theicons displayed immersive multimedia image 518, which operate in thesame or similar manner as describe for FIGS. 2A and 2B. In addition, auser may select an input option (506), such as “Annotate Photo” from amenu displayed by the Claims App 500, which can open the immersivemultimedia image in a full screen view or a VR visualization view forannotation as describe herein. As describe herein, the user may addannotations to the immersive multimedia images to highlight certainpoints of interest.

The annotations may be made by the user before or after the immersivemultimedia images are submitted. In one embodiment, for example, a usermay first submit a non-annotated immersive multimedia image to providerserver(s) 150. Once the immersive multimedia image has been submitted,the user may use the Claims App 502, which may be in communication withthe provider server(s) 150 via computer network 140, to annotate theremote immersive multimedia images by accessing the Claims App 502 andspecifying the annotations to add and positions of the annotationswithin the remote immersive multimedia images. In another embodiment,the user may annotate the immersive multimedia image using the ClaimsApp 502 prior to submitting the immersive multimedia images to server(s)150. For example, the user may annotate the immersive multimedia imagesas described for FIGS. 2A and 2B herein. In a further embodiment, theuser may annotate a first set of one or more immersive multimedia imagesprior to submitting the first set to server(s) 150 and may submit asecond set of immersive multimedia images with no annotations. The usermay then access the server(s) 150 to update the first or second set ofimmersive multimedia images with additional or new annotations.

In some embodiments, the Claims App 502 may provide a user may with aselectable list of one or more annotations, where a selection of aparticular annotation from the list causes the immersive multimediaimage to be augmented with the particular selected annotation. Forexample, in some aspects, a predetermined checklist of common or typicalidentifiable annotations associated with a particular damage event maybe provided to the user for selection. Such annotations can include, forexample, “point of impact” for a vehicular accident damage event or“source of fire” for a household damage event. The predeterminedchecklist can assist the user in describing the damage scene withcommonly used terms by a third party servicer, such as an insurancecompany or repair or remedial service.

In a similar embodiment, the Claims App 502 may provide story options toselect from. Such story options can include common or readilyrecognizable annotations associated with particular damages events ordamage scenes. For example, for an automobile accident, the storyoptions can include annotations such as “main point of damage onvehicle,” “front of vehicle,” “side of vehicle,” used for annotating avehicle depicted in immersive multimedia image. Other annotations forthe automobile based story mode can relate to the damage scene,including, for example, “intersection of crash event,” “other vehicleinvolved in crash,” “location of crash event,” or other annotations thatdescribe the scene or environment of the crash event. As anotherexample, for a household damage event, the story options can includeannotations such as “fire damage area,” “area of likely cause of firedamage start,” “water damage area,” “area of likely cause of waterdamage start,” or other annotations that describe the scene orenvironment associated with the household or property damage event.

In other embodiments, the Claims App 502 may provide an option for theuser to authenticate or otherwise verify the submitted immersivemultimedia image(s), and any of the annotated information provided withthe immersive multimedia images. The verification can include averification indicator, such as a checkbox, or signature box, providedvia the Claims App 502 that the user, or other witness, can indicate,authenticate or otherwise verify the accuracy of the immersivemultimedia images, annotations or related information.

FIG. 5C illustrates the exemplary user interface 500 of the computingdevice of FIG. 5B depicting an exemplary annotated version 520 of theimmersive multimedia image 518 associated with the damages scene of FIG.5B. For example, annotated immersive multimedia image 520 may representthe same or different view immersive multimedia image 518. A differentview could include a rotated view or different vantage point ofimmersive multimedia image 518. In the example embodiment of FIG. 5C,the annotated immersive multimedia image 520 depicts the damaged vehicle204, as shown in FIGS. 2A and 2B, where the user has annotated theimmersive multimedia image 518 with the text-based annotation “Point ofImpact” to create the annotated immersive multimedia image 520 thatshows where the damage occurred to the vehicle.

In some embodiments, once an annotation is made to the immersivemultimedia image, the claim including related information (e.g.,510-516), and including all images and immersive multimedia image(s),whether annotated or not, may be submitted to the related insurancecompany. In another embodiment, the claim related information, theimmersive multimedia image(s), and/or annotations may each be submittedseparately, such as overtime (e.g., immediately after the damage eventor at some time thereafter) as more detail is discovered for the damageevent and/or damage scene.

FIG. 6 illustrates a flow diagram of an exemplary method for annotatingand visualizing a damage scene. The method begins (602) where acomputing device, such as a computing device 120 of person 102 from FIG.1, generates immersive multimedia image(s) (block 604). The immersivemultimedia image(s) may be associated with a damage scene, such as adamages scene related to a vehicular accident or a property damageevent. The immersive multimedia image(s) can include any of 360-degreephotographs, panoramic photographs, 360-degree videos and/or panoramicvideos as described herein. In some embodiments, the immersivemultimedia image(s) may be created from multiple non-360-degree ornon-panoramic photographs or videos. The immersive multimedia image(s)may be saved as computer files, such as JPEG, PNG, or MPEG files.

At block 606, the immersive multimedia image(s) may be augmented withannotation(s) to create annotated immersive multimedia image(s). Invarious embodiments, the annotation(s) can include any of a text-basedannotation (e.g., indicating a “point of impact” or “point of interest”text-based annotation), a voice-based annotation, a graphicalannotation, a video-based annotation, an augmented reality annotation,or a mixed reality annotation. The augmented or mixed realityannotations can include, for example, superimposed images or graphics toadd additional detail to the original immersive multimedia image(s). Forexample, the damages scene may be annotated with an augmented realityannotation or a mixed reality annotation that describes the damagesscene at or near a time when the related damage event occurred in orderto enhance the damage scene for visualization purposes as describedherein. The annotation information can come from various or multiplesources, including the person who originally captured the immersivemultimedia image(s), or from third party sources, such as Google, Waze,Zillow, or other sources as described herein.

In some embodiments, a user can select from a display listing ofpreexisting annotations, that can include any of the text-based,graphic-based, video based, augmented reality-based or mixedreality-based or other annotations described herein, and that may beused to augment immersive multimedia images to create annotatedimmersive multimedia images.

In some embodiments, the annotated immersive multimedia image(s) may beannotated with metadata, which, for example, can include GPS information(e.g., that can provide the location of the damage event or scene, thelocation where a vehicle was located before or at the time of the damageevent, or the location of a user when capturing an immersive multimediaimage), a time stamp for when the damage occurred, humidity,temperature, or road conditions. In some embodiments, the metadata mayalso include pictures that were posted by other users or witnesses onsocial media platforms such as Facebook or pictures from other thirdparty sources, such as pictures of properties posted on Zillow. In otherembodiments, the metadata may also include information about the damagesscene, such as whether there was area an intersection or whether therewas stop sign that was viewable or hidden from view. In still furtherembodiments, the metadata may include telematics data captured from oneor more vehicles involved in a crash. For example, the telematics datamay be used in certain embodiments to create a simulation video of thedamage scene based on the telematics data and one or more immersivemultimedia image(s) that depict the damage scene. For example, in oneembodiment, the telematics may be used together with map images fromGoogle Maps or immersive multimedia image(s) from Google Street View tomap a sequence of pre-crash events (e.g., whether a vehicle was turninginto a parking lot or lane), and then using the pre-crash sequence candepict the crash route to recreate the damage event. Other data,including GPS data (such as timestamp data), road conditions, witnessstatements, etc. may be used to further enhance the accuracy of therecreated damage event.

At block 608, the annotated immersive multimedia image(s) may then bevisualized using a virtual reality (VR) device, such as first VR device130 or 154 of FIG. 1, where the damage scene and the annotation(s) ofthe annotated immersive multimedia image(s) can be viewed via the VRdevice. In some embodiments, the generation of immersive multimediaimage(s) can occur at or near the damage scene, but the visualization ofthe immersive multimedia image(s) can occur at a location remote to thedamage scene using a virtual reality (VR) device. For example, person102 can capture the immersive multimedia image(s) and may transmit theimmersive multimedia image(s) to provider server(s) 150 where a providerrepresentative may visualize the immersive multimedia image(s) in secondVR device 154.

In some embodiments, the damage scene of an immersive multimedia imagecan depict a damaged item, such as vehicle 204 for FIG. 2A, having apoint of impact annotation associated with the damaged item. In theexample embodiment, a prior image of the damaged item can be overlaid onor displayed together with at the immersive multimedia image in order toshow the extent of damage of the damaged item, for example, how the itemlooked before it was damaged and how it looked after it was damaged.

FIG. 7 illustrates a flow diagram of an exemplary method for enhancingand developing a damage scene visualization. The method may begin (702)where one or more processors, such as one or more processors of providerserver(s) 150, receive annotated immersive multimedia image(s) from afirst user (block 704). In some embodiments, the annotated immersivemultimedia image(s) can be associated with a damage scene. For example,the first user may be an individual involved in a damage event at adamage scene, and associated with a damaged item, such as an insurancecustomer involved in an automobile accident and associated with adamaged vehicle. The first user may capture immersive multimediaimage(s) as described herein and submit the annotated immersivemultimedia images to a third party, for example, via computer network140. For example, the third party may be an insurance provider orremedial services provider associated with post-event activities. In oneembodiment, for example, the annotated immersive multimedia images maybe received and used by remedial services provider, such as anautomobile repair service or a fire damage restoration service, todetermine what products, services, tools or other assets are needed torepair the damaged item. Based on the same or similar analysis, theremedial services provider may also be able to determine a damagesamount associated with repairing or replacing the damaged item or items.

In another embodiment, the immersive multimedia images may be sent to aninsurance company or insurance representative, such a claims adjuster,for determining a damages amount and/or for adjusting a claim based onthe information provided by the annotated immersive multimedia images,or visualizations thereof, as described herein. In other embodiments,the immersive multimedia images may be used to train new insurancerepresentatives. For example, a claims adjuster can be trained usingpast or current immersive multimedia images, and/or the visualizationsystems and methods as described herein, to determine the damages amountor to otherwise adjust past or current insurance claims based onexisting or current immersive multimedia images.

At block 706 the annotated immersive multimedia image(s) may be used torender a visualization using a VR device, such as second VR device 154,associated with a second user. In some embodiments, the second user canbe a provider representative, such as a claims adjuster or insuranceclaims trainee of an insurance provider, or a remedial or repairservices representative of a repair or remedial company associated withrepairing damaged items related to the damage scene. In someembodiments, the second user, including a provider representative, suchas a claims adjuster or handler, can visualize the immersive multimediaimages using a virtual reality (VR) device, such as second VR device154, and related VR application. For example, the second user caninitiate the VR application to analyze, annotate or otherwise review theimmersive multimedia images in virtual reality mode. Where the providerrepresentative is using Google Cardboard, for example, the VR devicewould include the Google Cardboard housing and a compatible interfacedevice, for example, a compatible smart phone, such as a Google Androidbased phone or an Apple iOS based phone. The second user would then havefull a full 360-degree virtual reality view of the damage scene toanalyze and inspect related details with enhanced clarity that virtualreality provides. For example, the second user would be able to see therelationship of objects to one another and could get a more detailedperspective on the damage scene, causes of the damage, etc. In someembodiments, annotations that were made by the first user, second user,or other person could be displayed in the virtual reality visualizationto create an augmented reality experience. For example, in someembodiments, the annotations could appear as the user's view moved overan area in the visualization that was annotated. In various embodiments,the annotations could include any of one or more text-based annotations,voice-based annotations, graphic-based annotations, an augmented realityannotation, and/or a mixed reality annotations, as described herein.

In some embodiments, the second user may enhance the annotated immersivemultimedia image(s) provided by the first user, where the annotatedimmersive multimedia image(s) provided by the first user are augmentedby the second user with additional annotation(s). In some embodiments,the additional annotation(s) can be transmitted from the first user viaa computer network to the second user. In some embodiments, each of theannotated immersive multimedia images can include timestamp value(s)that can indicate when the annotated immersive multimedia image(s) weregenerated, received, stored, etc.

In one example embodiment, the enhanced immersive multimedia image canbe a mixed reality immersive multimedia image, where an annotation, suchas a graphical annotation, is used to generate the mixed realityimmersive multimedia image by augmenting the annotated immersivemultimedia image(s) of the first user with the graphical annotation.

In some embodiments, a verification indication may be received from thefirst user, where the verification indication indicates that theenhanced immersive multimedia image represents an interpretation of thedamage scene as determined by the first user.

At block 708, the VR visualization may be used to determine a damageamount, where the damage amount is determined from one or more damageditems identifiable in the annotated immersive multimedia images. In someembodiments, the damaged items identifiable in the VR visualization canhave predetermined values. In various aspects, the predetermined valuesof multiple damaged items may be used to calculate a sum total damageamount. In some embodiments, the damage amount may be modified, forexample, by a claims adjuster of an insurance company associated with adamages claim associated with the damaged item.

In some embodiments, the annotated immersive multimedia images from thefirst user may be stored by a computing device, such as server(s) 150,at an initial time and may be accessed, for example, by second VR device154, to render a VR visualization at a later time.

In some embodiments, the augmented immersive multimedia image(s) of thefirst user are capable of being displayed on a web browser ascorresponding two dimensional (2D) image(s) via an online application.For example, the web browser could be operated by the second user onprovider computing device 152 where the online application runs on theprovider server(s) 150 as a client-server based online applicationimplemented, for example, in Java Server Pages (JSP), Microsoft .NetActive Server Pages (ASP), Ruby on Rails, etc. For example, the seconduser can review immersive multimedia images using the onlineapplication, where the annotated immersive multimedia images can bedragged and rotated around on the screen of provider computing device152 to see the entire damage scene, or the screen of a provider tabletdevice (not shown) or provider mobile device (not shown).

In still a further embodiment, a second user, such as the third partyinsurance representative or repair representative may request additionalimmersive multimedia images from a first user, such as the individualwho took a first set of immersive multimedia images. For example, aclaims adjuster reviewing a claim and related immersive multimediaimages submitted by an insurance customer regarding household damage mayrequest that the insurance customer provide additional immersivemultimedia images so that the claims adjuster can better visualize, orhave more information, for visualizing the damage scene in the claimsadjuster's VR device. In such an embodiment, the claim's adjuster mayinteract with the customer, for example, ask additional questions andget more feedback from the customer that can be used to further annotatethe immersive multimedia images. For example, the claims adjuster couldannotate the customer's submitted immersive multimedia images on behalfof the customer as the customer and the claim's adjuster communicate viaa phone connection.

In another embodiment, the first user and the second user maysimultaneously visualize the enhanced immersive multimedia image onrespective first and second VR devices. For example, both a claimsadjuster and an insurance customer may simultaneously visualize thecustomer's submitted immersive multimedia images via respective VRdevices. For example, the claim's adjuster could visualize an immersivemultimedia image via second VR device 154 of FIG. 1 and the customercould visualize the same immersive multimedia image via first VR device130 of FIG. 1, where the visualization information would be sent fromeither the customer to the claims adjuster, or vice versa, over computernetwork 140 of FIG. 1 In this way, both the customer and the claim'sadjuster would be able to view, annotate, or otherwise interact with thesame immersive multimedia image at the same time. In some embodiments,the first user and the second user may be at remote locations.

In other embodiments, the claim's adjuster could assist the customerselect annotation options from a menu or list to annotate and furtherenhance the information provided by the VR visualization as describeherein. For example, a selectable list of annotation(s) may be providedto the first user, where selection of a particular annotation from thelist of annotation(s) by the first user causes the enhanced immersivemultimedia image to be augmented with the particular annotation.

Additional Considerations

Although the following text sets forth a detailed description ofnumerous different embodiments, it should be understood that the legalscope of the description is defined by the words of the claims set forthat the end of this patent and equivalents. The detailed description isto be construed as exemplary only and does not describe every possibleembodiment since describing every possible embodiment would beimpractical. Numerous alternative embodiments may be implemented, usingeither current technology or technology developed after the filing dateof this patent, which would still fall within the scope of the claims.

The following additional considerations apply to the foregoingdiscussion. Throughout this specification, plural instances mayimplement components, operations, or structures described as a singleinstance. Although individual operations of one or more methods areillustrated and described as separate operations, one or more of theindividual operations may be performed concurrently, and nothingrequires that the operations be performed in the order illustrated.Structures and functionality presented as separate components in exampleconfigurations may be implemented as a combined structure or component.Similarly, structures and functionality presented as a single componentmay be implemented as separate components. These and other variations,modifications, additions, and improvements fall within the scope of thesubject matter herein.

Additionally, certain embodiments are described herein as includinglogic or a number of routines, subroutines, applications, orinstructions. These may constitute either software (e.g., code embodiedon a machine-readable medium or in a transmission signal) or hardware.In hardware, the routines, etc., are tangible units capable ofperforming certain operations and may be configured or arranged in acertain manner. In example embodiments, one or more computer systems(e.g., a standalone, client or server computer system) or one or morehardware modules of a computer system (e.g., a processor or a group ofprocessors) may be configured by software (e.g., an application orapplication portion) as a hardware module that operates to performcertain operations as described herein.

The various operations of example methods described herein may beperformed, at least partially, by one or more processors that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors may constitute processor-implemented modulesthat operate to perform one or more operations or functions. The modulesreferred to herein may, in some example embodiments, compriseprocessor-implemented modules.

Similarly, the methods or routines described herein may be at leastpartially processor-implemented. For example, at least some of theoperations of a method may be performed by one or more processors orprocessor-implemented hardware modules. The performance of certain ofthe operations may be distributed among the one or more processors, notonly residing within a single machine, but deployed across a number ofmachines. In some example embodiments, the processor or processors maybe located in a single location, while in other embodiments theprocessors may be distributed across a number of locations.

The performance of certain of the operations may be distributed amongthe one or more processors, not only residing within a single machine,but deployed across a number of machines. In some example embodiments,the one or more processors or processor-implemented modules may belocated in a single geographic location (e.g., within a homeenvironment, an office environment, or a server farm). In otherembodiments, the one or more processors or processor-implemented modulesmay be distributed across a number of geographic locations.

This detailed description is to be construed as exemplary only and doesnot describe every possible embodiment, as describing every possibleembodiment would be impractical, if not impossible. One may be implementnumerous alternate embodiments, using either current technology ortechnology developed after the filing date of this application.

Those of ordinary skill in the art will recognize that a wide variety ofmodifications, alterations, and combinations can be made with respect tothe above described embodiments without departing from the scope of theinvention, and that such modifications, alterations, and combinationsare to be viewed as being within the ambit of the inventive concept.

The patent claims at the end of this patent application are not intendedto be construed under 35 U.S.C. § 112(f) unless traditionalmeans-plus-function language is expressly recited, such as “means for”or “step for” language being explicitly recited in the claim(s). Thesystems and methods described herein are directed to an improvement tocomputer functionality, and improve the functioning of conventionalcomputers.

What is claimed is:
 1. A visualization system configured for enhancingand developing a damage scene visualization, the visualization systemcomprising: a damage scene visualization app configured to visualize,via a first virtual reality (VR) device of a first user, a plurality ofimmersive multimedia images, each of the plurality of immersivemultimedia images captured at or near a location of a damage event andcomprising multiple viewing angles of a vantage point defining a damagescene of the damage event, the damage scene visualization app furtherconfigured to accept one or more augmentation commands identifying oneor more damage positions associated with damaged items within the damagescene, and the damage scene visualization app configured fortransmission of each of the plurality of immersive multimedia images ina first state and a second state, the first state being a non-annotatedstate and the second state being an annotated state; one or morevisualization processors operable to visualize immersive multimediaimages in VR; and a second VR device of a second user communicativelycoupled to the one or more visualization processors, the visualizationprocessors and the second VR device associated with instructions forrendering immersive multimedia images in VR, the one or morevisualization processors configured to: receive, via a computer network,the plurality of immersive multimedia images from the damage scenevisualization app, determine, for each immersive multimedia image of theplurality of immersive multimedia images, a transmission state of agiven multimedia image of the plurality of immersive multimedia images,such that (1) when the transmission state is of the first state, thegiven immersive multimedia image is augmented by the one or morevisualization processors to generate a corresponding VR annotatedimmersive multimedia image, and (2) when the transmission state is ofthe second state, the given immersive multimedia image is not augmentedby one or more visualization processors, the given immersive multimediaimage of the second state previously augmented by the damage scenevisualization app to generate the corresponding VR annotated immersivemultimedia image, wherein, for each of the first state and the secondstate, the corresponding VR annotated immersive multimedia image isaugmented such that one or more of the multiple viewing angles of thevantage point of the plurality of immersive multimedia images includesthe one or more damage positions associated with the damaged itemswithin the damage scene, render a visualization comprising thecorresponding VR annotated immersive multimedia image and the multipleviewing angles of the vantage point defining the damage scene and thedamage event, and determine a damage amount based on the visualization,wherein the damage amount is determined from one or more damaged itemsidentifiable by the damage positions associated with the damaged itemswithin the damage scene.
 2. The visualization system of claim 1, the oneor more visualization processors further configured to generate anenhanced immersive multimedia image based on the corresponding VRannotated immersive multimedia image, wherein the corresponding VRannotated immersive multimedia image is augmented with an additionalannotation via the second VR device.
 3. The visualization system ofclaim 2, wherein the enhanced immersive multimedia image is a mixedreality immersive multimedia image, and wherein the additionalannotation is a graphical annotation, and wherein the mixed realityimmersive multimedia image is generated by augmenting, via the second VRdevice, the corresponding VR annotated immersive multimedia image withthe graphical annotation.
 4. The visualization system of claim 2, theone or more visualization processors further configured tosimultaneously visualize the enhanced immersive multimedia image via thesecond VR device associated with the second user and the first VR deviceassociated with the first user, wherein the first user is at a locationremote from the second user.
 5. The visualization system of claim 2,wherein the additional annotation is transmitted from the damage scenevisualization app via the computer network to the second VR device. 6.The visualization system of claim 2, the one or more visualizationprocessors further configured to receive a verification indication fromthe damage scene visualization app, the verification indicationindicating that the enhanced immersive multimedia image represents aninterpretation of the damage scene as determined by the first user. 7.The visualization system of claim 2, the one or more visualizationprocessors further configured to provide a selectable list of one ormore annotations via the damage scene visualization app, whereinselection of a particular annotation from the list of one or moreannotations by the first user causes the enhanced immersive multimediaimage to be augmented with the particular annotation.
 8. Thevisualization system of claim 1, the visualization system furthercomprising: an online application capable of being operated via a webbrowser, and, wherein the plurality of immersive multimedia images arecapable of being displayed as one or more corresponding two dimensional(2D) images via the online application.
 9. The visualization system ofclaim 1, wherein the second user is one or more of the following: aninsurance claims adjuster or an insurance claims trainee.
 10. Thevisualization system of claim 1, further comprising one or more computermemories, and wherein the one or more visualization processors arefurther configured to store in the one or more computer memories theplurality of immersive multimedia images at an initial time and renderthe visualization at a later time, wherein each of the plurality ofimmersive multimedia images includes a timestamp value.
 11. Acomputer-implemented visualization method for enhancing and developing adamage scene visualization, the computer-implemented visualizationmethod comprising: visualizing, via a damage scene visualization appcommunicatively coupled to a first virtual reality (VR) device of afirst user, a plurality of immersive multimedia images, each of theplurality of immersive multimedia images captured at or near a locationof a damage event and comprising multiple viewing angles of a vantagepoint defining a damage scene of the damage event; accepting, via thedamage scene visualization app, one or more augmentation commandsidentifying one or more damage positions associated with damaged itemswithin the damage scene; transmitting, via the damage scenevisualization app, each of the plurality of immersive multimedia imagesin a first state and a second state, the first state being anon-annotated state and the second state being an annotated state;receiving, via a computer network at one or more visualizationprocessors operable to visualize immersive multimedia images in VR, theplurality of immersive multimedia images from the damage scenevisualization app; determining, for each immersive multimedia image ofthe plurality of immersive multimedia images, a transmission state of agiven multimedia image of the plurality of immersive multimedia images,such that (1) when the transmission state is of the first state, thegiven immersive multimedia image is augmented by the one or morevisualization processors to generate a corresponding VR annotatedimmersive multimedia image, and (2) when the transmission state is ofthe second state, the given immersive multimedia image is not augmentedby one or more visualization processors, the given immersive multimediaimage of the second state previously augmented by the damage scenevisualization app to generate the corresponding VR annotated immersivemultimedia image; wherein, for each of the first state and the secondstate, the corresponding VR annotated immersive multimedia image isaugmented such that one or more of the multiple viewing angles of thevantage point of the plurality of immersive multimedia images includesthe one or more damage positions associated with the damaged itemswithin the damage scene; rendering, via a second VR device of a seconduser communicatively coupled to the one or more visualizationprocessors, a visualization comprising the corresponding VR annotatedimmersive multimedia image and the multiple viewing angles of thevantage point defining the damage scene and the damage event; anddetermining a damage amount based on the visualization, wherein thedamage amount is determined from one or more damaged items identifiableby the damage positions associated with the damaged items within thedamage scene.
 12. The computer-implemented visualization method of claim11, further comprising generating an enhanced immersive multimedia imagebased on the corresponding VR annotated immersive multimedia image,wherein the corresponding VR annotated immersive multimedia image isaugmented with an additional annotation via the second VR device. 13.The computer-implemented visualization method of claim 12, wherein theenhanced immersive multimedia image is a mixed reality immersivemultimedia image, and wherein the additional annotation is a graphicalannotation, and wherein the mixed reality immersive multimedia image isgenerated by augmenting, via the second VR device, the corresponding VRannotated immersive multimedia image with the graphical annotation. 14.The computer-implemented visualization method of claim 12, furthercomprising simultaneously visualizing the enhanced immersive multimediaimage via the second VR device associated with the second user and thefirst VR device associated with the first user, wherein the first useris at a location remote from the second user.
 15. Thecomputer-implemented visualization method of claim 12, wherein theadditional annotation is transmitted from the damage scene visualizationapp via the computer network to the second VR device.
 16. Thecomputer-implemented visualization method of claim 12, furthercomprising receiving a verification indication from the damage scenevisualization app, the verification indication indicating that theenhanced immersive multimedia image represents an interpretation of thedamage scene as determined by the first user.
 17. Thecomputer-implemented visualization method of claim 12, furthercomprising providing a selectable list of one or more annotations viathe damage scene visualization app, wherein selection of a particularannotation from the list of one or more annotations by the first usercauses the enhanced immersive multimedia image to be augmented with theparticular annotation.
 18. The computer-implemented visualization methodof claim 11, further comprising an online application capable of beingoperated via a web browser, and, wherein the plurality of immersivemultimedia images are capable of being displayed as one or morecorresponding two dimensional (2D) images via the online application.19. The computer-implemented visualization method of claim 11, whereinthe one or more visualization processors are further configured to storein one or more computer memories the plurality of immersive multimediaimages at an initial time and render the visualization at a later time,wherein each of the plurality of immersive multimedia images includes atimestamp value.
 20. A tangible, non-transitory computer-readable mediumstoring instructions for enhancing and developing a damage scenevisualization that, when executed by one or more visualizationprocessors operable to visualize immersive multimedia images in virtualreality (VR), cause the one or more visualization processors to:visualize, via a damage scene visualization app communicatively coupledto a first virtual reality (VR) device of a first user, a plurality ofimmersive multimedia images, each of the plurality of immersivemultimedia images captured at or near a location of a damage event andcomprising multiple viewing angles of a vantage point defining a damagescene of the damage event; accept, via the damage scene visualizationapp, one or more augmentation commands identifying one or more damagepositions associated with damaged items within the damage scene;transmit, via the damage scene visualization app, each of the pluralityof immersive multimedia images in a first state and a second state, thefirst state being a non-annotated state and the second state being anannotated state; receive, via a computer network at one or morevisualization processors operable to visualize immersive multimediaimages in VR, the plurality of immersive multimedia images from thedamage scene visualization app; determine, for each immersive multimediaimage of the plurality of immersive multimedia images, a transmissionstate of a given multimedia image of the plurality of immersivemultimedia images, such that (1) when the transmission state is of thefirst state, the given immersive multimedia image is augmented by theone or more visualization processors to generate a corresponding VRannotated immersive multimedia image, and (2) when the transmissionstate is of the second state, the given immersive multimedia image isnot augmented by one or more visualization processors, the givenimmersive multimedia image of the second state previously augmented bythe damage scene visualization app to generate the corresponding VRannotated immersive multimedia image; wherein, for each of the firststate and the second state, the corresponding VR annotated immersivemultimedia image is augmented such that one or more of the multipleviewing angles of the vantage point of the plurality of immersivemultimedia images includes the one or more damage positions associatedwith the damaged items within the damage scene; render, via a second VRdevice of a second user communicatively coupled to the one or morevisualization processors, a visualization comprising the correspondingVR annotated immersive multimedia image and the multiple viewing anglesof the vantage point defining the damage scene and the damage event; anddetermine a damage amount based on the visualization, wherein the damageamount is determined from one or more damaged items identifiable by thedamage positions associated with the damaged items within the damagescene.